Papers with transport flow
Enable Fast Sampling for Seq2Seq Text Diffusion (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing text generation methods use autoregressive (AR) methods, which generate tokens one by one, but are time-consuming. |
| Approach: | They propose an efficient model FMSeq which utilizes flow matching to straighten the generation path, thereby enabling fast sampling for diffusion-based seq2seq text generation. |
| Outcome: | The proposed model generates comparable quality to the SOTA diffusion-based DiffuSeq in just 10 steps, achieving a 200-fold speedup. |